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Abstract — In this paper we present a method for automati- 
cally generating optimal robot trajectories satisfying high level 
mission specifications. The motion of the robot in the envi- 
ronment is modeled as a general transition system, enhanced 
with weighted transitions. The mission is specified by a general 
linear temporal logic formula. In addition, we require that 
an optimizing proposition must be repeatedly satisfied. The 
cost function that we seek to minimize is the maximum time 
between satisfying instances of the optimizing proposition. For 
every environment model, and for every formula, our method 
computes a robot trajectory which minimizes the cost function. 

The problem is motivated by applications in robotic mon- 
itoring and data gathering. In this setting, the optimizing 
proposition is satisfied at all locations where data can be up- 
loaded, and the entire formula specifies a complex (and infinite 
horizon) data collection mission. Our method utilizes Biichi 
automata to produce an automaton (which can be thought of 
as a graph) whose runs satisfy the temporal logic specification. 
We then present a graph algorithm which computes a path 
corresponding to the optimal robot trajectory. We also present 
an implementation for a robot performing a data gathering 
mission in a road network. 



I. Introduction 

The goal of this paper is to plan the optimal motion of 
a robot subject to temporal logic constraints. This is an 
important problem in many applications where the robot 
has to perform a sequence of operations subject to external 
constraints. For example, in a persistent data gathering task 
the robot is tasked to gather data at several locations and 
then visit a different set of upload sites to transmit the data. 
Referring to Fig. [Tl we would like to enable tasks such as 
"Repeatedly gather data at locations PI, P4, and P5. Upload 
data at either P2 or P3 after each data-gather Follow the 
road rules, and avoid the road connecting 14 to 12." We 
wish to determine robot motion that completes the task, 
and minimizes a cost function, such as the maximum time 
between data uploads. 

Recently there has been an increased interest in using 
temporal logic to specify mission plans for robots [1], [2], 
[3], [4], [5], [6], [7]. Temporal logic is appealing because it 
provides a formal high level language in which to describe a 
complex mission. In addition, tools from model checking [8], 
[9], [10], [11] can be used to verify the existence of a robot 
trajectory satisfying the specification, and can produce a 
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Fig. 1. An environment consisting of roads, intersections and parking 
lots. An example mission in the environment is "Repeatedly gather data at 
locations PI, P4, and P5. Upload data at either P2 or P3 after each data- 
gather. Follow the road rules, and avoid the road connecting 14 to 12." 



satisfying trajectory. However, frequently there are multiple 
robot trajectories that satisfy a given specification. In this 
case, one would like to choose the "optimal" trajectory 
according to a cost function. The current tools from model 
checking do not provide a method for doing this. In this 
paper we consider linear temporal logic specifications, and 
a particular form of cost function, and provide a method for 
computing optimal trajectories. 

The problem considered in this paper is related to the 
vehicle routing problem (VRP) [12]. The VRP is a gener- 
alization of the traveling salesman problem (TSP) in which 
the goal is to plan routes for vehicles to service customers. 
Vehicle routing extends the TSP by considering aspects 
such as multiple vehicles, vehicles with capacity constraints, 
and vehicles that must depart and return to specified depot 
locations. In [13], the authors consider a vehicle routing 
problem with metric temporal logic constraints. The goal 
is to minimize a cost function of the vehicle paths (such 
as total distance traveled). The authors present a method for 
computing an optimal solution by converting the problem to a 
mixed integer linear program (MILP). However, their method 
only applies to specifications where the temporal operators 
are applied only to atomic propositions. Thus, the method 
does not apply to persistent monitoring and data gathering 
problems, which have specifications of the form "always 
eventually." In addition, the approach that we present in this 
paper leads to an optimization problem on a graph, rather 
than a MILP 

The contribution of this paper is to present a cost function 
for which we can determine an optimal robot trajectory that 
satisfies a general linear temporal logic formula. The cost 
function is motivated by problems in monitoring and data 



gathering, and it seeks to minimize the time between satisfy- 
ing instances of a single optimizing proposition. Our solution, 



summarized in the Optimal-Run algorithm of Section IV 



operates as follows. We represent the robot and environment 
as a weighted transition system. Then, we convert the lin- 
ear temporal logic specification to a Biichi automaton. We 
synchronize the transition system with the Biichi automaton 
creating a product automaton. In this automaton a satisfying 
run is any run which visits a set of accepting state infinitely 
often. We show that there exists an optimal run that is in 
"prefix-suffix" structure, implying that we can search for runs 
with a finite transient, followed by a periodic steady-state. 
Thus, we create a polynomial time graph algorithm based 
on solutions of bottleneck shortest path problems to find an 
optimal cycle containing an accepting state. We implement 
our solution on the physical testbed shown in Fig. [T] We 
believe that optimizations of this type may be useful for a 
broader class of problems than the one considered here. 

For simplicity of the presentation, we assume that the 
robot moves among the vertices of an environment modeled 
as a graph. However, by using feedback controllers for 
facet reachability and invariance in polytopes [14], [15], 
[16] the method developed in this paper can be easily 
applied for motion planning and control of a robot with 
"realistic" continuous dynamics (e.g., unicycle) traversing an 
environment partitioned using popular partitioning schemes 
such as triangulations and rectangular partitions. 

The organization of the paper is as follows. In Section [ll] 
we present preliminary results in temporal logic. In Sec- 
tion III we formally state the robot motion planning problem. 



and in Section IV we present our solution. In Section W\ we 
present results from a motion planning experiment for one 
robot in a road network environment. Finally in Section |VI] 
we present some promising future directions. 

II. Preliminaries 

In this section we briefly review some aspects of linear 
temporal logic (LTL). LTL considers a finite set of variables 
n, each of which can be either true or false. The variables 
a^ G n are called atomic propositions. In the context of 
robots, propositions can capture properties such as "the robot 
is located in region 1", or "the robot is recharging." 

Given a system model, LTL allows us to express the time 
evolution of the state of the system. We consider a type of 
finite model called the weighted transition system. 

Definition II.l (Weiglited Transition System) A weighted 
transition system is a tuple T '.= {Q, qo, R, 11, £, w), consist- 
ing of (i) a finite set of states Q; (ii) an initial state qo G Q; 
(Hi) a transition relation R Q Q x Q; (iv) a set of atomic 
propositions H; (v) a labeling function C : Q —^ 2^; (vi) a 
weight function w : R ^>- M>o. 

We assume that the transition system is non-blocking, imply- 
ing that there is a transition from each state. The transition 
relation has the expected definition: given that the system is 
in state qi G Q at time ii, the system is in state q2 at time 
ti + w(^{qi,q2)) if and only if {qi,q2) G R. The labeling 



n = {recharge, gather, upload} 

C{qo) = (go J^ ^ 3v^ ''-(''i' = {upload} 

^'l2) = {gather}('g2 J -^93 ) Ciq;,) = {upload, recharge} 

Fig. 2. An example of a weighted transition system. A correct run 
of the system is for instance qoQ2QiQoQ2Q3go ■ ■ ■, producing the word 
0{gather}{upload}0{gather}{upload,recharge}0 . . .. 



function defines for each state q £ Q, the set C(q) of all 
atomic propositions valid in q. For example, the proposition 
"the robot is recharging" will be valid for all states q E Q 
containing recharging stations. 

For our transition system we can define a run rj- to be 
an infinite sequence of states go'?i92 • ■ • such that qo G Qo, 
qi G Q, for all i, and {qi,qi+i) G R, for all i. A run rj- 
defines a word C{qo)C{qi)C{q2) ■ . ■ consisting of sets of 
atomic propositions valid at each state. An example of a 
weighted transition system is given in Fig. l2] 

Definition II.2 (Formula of LTL) An LTL formula cj) over 
the atomic propositions H is defined inductively as follows: 

0::=T I a I (/)V(/)| ^(/)| X<?!)| (j)U (/) 

where T is a predicate true in each state of a system, 
a € n is an atomic proposition, -^ (negation) and V 
(disjunction) are standard Boolean connectives, and X and 
U are temporal operators. 

LTL formulas are interpreted over infinite runs, as those 



generated by the transition system T from Def. II.l Infor- 
mally, X a states that at the next state of a run, proposition 
a is true (i.e., a G C{qi)). In contrast, aiU a2 states that 
there is a future moment when proposition a2 is true, and 
proposition ai is true at least until a2 is true. From these 
temporal operators we can construct two other useful oper- 
ators Eventually (i.e., future), F defined as F (p :— TUip, 
and Always (i.e., globally), G, defined as G (/i := ^ F ^ (/>. 
The formula G a states that proposition a holds at all states 
of the run, and F a states that a holds at some future time 
instance. 

An LTL formula can be represented in an automata- 
theoretic setting as Biichi automaton, defined as follows; 

Definition II.3 (Biiclii Automaton) A Biichi automaton is 
a tuple B :— (S, So, S, 6, F), consisting of (i) a finite set of 
states S; (ii) a set of initial states So ^ "S*; (///) an input 
alphabet S; (iv) a non-deterministic transition relation S C 
S X T, X S; (v) a set of accepting (final) states F (- S. 

The semantics of Biichi automata are defined over infinite 
input words. Setting the input alphabet S = 2^, the seman- 
tics are defined over the words consisting of sets of atomic 
propositions, i.e. those produced by a run of the transition 
system. Let oj ~ ujoi^i(^2 ■ ■ ■ be an infinite input word of 
automaton B, where uji G S for each i E N (for example, the 



n = {recharge, gather, upload} 




gather A upload 



gather A upload 



Fig. 3. A Biichi automaton corresponding to LTL formula (G F gather A 
G F upload) over the alphabet EI. The illustration of the automaton is 
simplified. In fact, each transition labeled with T represents 1 2^ \ transitions 
labeled with all different subsets of atomic propositions. Similarly, a 
transition labeled with gather represent 1 2^^1/2 transitions labeled with 
all subsets of atomic propositions containing the proposition gather, etc. 



input w = C{qn)C{qi)C{q2) ■ ■ ■ could be a word produced 
by a run <7o9i'?2 • • • of the transition system 7~). 

A run of the Biichi automaton over an input word cj = 

ujouJibj2 ... is a sequence rjg = soSiS2 ■ ■ ., such that sq G Sq, 
and {si,uji, s^+i) G S, for all i eN. 

Definition II.4 (Biichi Acceptance) A word uj is accepted 
by the Biichi automaton B if and only if there exists rg over 
Lo SO that inf (rg) n -F 7^ 0, where inf (rg) denotes the set of 
states appearing infinitely often in run rg. 

The Biichi automaton allows us to determine whether or 
not the word produced by a run of the transition system 
satisfies an LTL formula. More precisely, for any LTL 
formula (p over a set of atomic propositions 11, there exists 
a Biichi automaton B^ with input alphabet 2^ accepting 
all and only the infinite words satisfying formula (p [8]- 
Translation algorithms were proposed in [17] and efficient 
implementations were developed in [18], [19]. The size of 
the obtained Biichi automaton is, in general, exponential with 
respect to the size of the formula. However, the exponential 
complexity is in practice not restrictive as the LTL formulas 
are typically quite small. An example of a Biichi automaton 
is given in Figure [3] 

III. Problem Statement and Approach 

Consider a single robot in an arbitrary environment, rep- 
resented as a transition system (as defined in Section III]) 
7" = (Q, 901^7 n,£, w). A run in the transition system 
starting at qq defines a corresponding trajectory of the robot 
in the environment. The time to take transition (gi, (72) G R 
(i.e., the time for the robot to travel from qi to (72 in the 
environment) is given by w{qi,q2)- 

To define our problem, we assume that there is an atomic 
proposition tt G 11, called the optimizing proposition. We 
consider LTL formulas of the form 



:= (pAGFn. 



(1) 



The formula ip can be any LTL formula over 11. The second 
part of the formula specifies that the proposition tt must 
be satisfied infinitely often, and will simply ensure well- 
posedness of our optimization. 

Let each run of T start at time t = 0, and assume that 
there is at least one run satisfying LTL formula ([T]). For 



each satisfying run rj- — go'?i92 • ■ •, there is a corresponding 
word of sets of atomic propositions cj = ^01^1^2 . . ., where 
uji — C{qi). Associated with rj- there is a sequence of time 
instances T := to,ti,t2, ■ ■ ■, where to = 0, and ti denotes 
the time at which state qi is reached (ii+i = ti+w{qi, qi+i))- 
From this time sequence we can extract all time instances at 
which the proposition n is satisfied. We let T^r denote the 
sequence of satisfying instances of the proposition tt. 

Our goal is to synthesize an infinite run rj- (i.e., a robot 
trajectory) satisfying LTL formula ([TJ, and minimizing the 
cost function 



C{ri) = lim sup (Ttt (i 

i— f +00 



1) 



T,W) 



(2) 



where T.,^{i) is the ith satisfying time instance of proposition 
TT. Note that a finite cost in (|2]) enforces that G F tt is 
satisfied. Thus, the specification appears in merely to 
ensure that any satisfying run has finite cost. In summary, 
our goal is the following; 



Problem Statement III.1 Determine an algorithm that 
takes as input a weighted transition system T, an LTL 
formula in form ([T]), and an optimizing proposition tt, and 
outputs a run rj- minimizing the cost C{rq-) in (|2|. 

We now make a few remarks, motivating this problem. 



Remarks III.2 (Comments on problem statement) Cost 
function form: The transition system produces infinite runs. 
Thus, cost function (|2| evaluates the steady-state time 
between satisfying instances of tt. In the upcoming sections 
we design an algorithm that produces runs which reach 
steady-state in finite time. Thus, the runs produced will 
achieve the cost in (|2| in finite time. 

Expressivity of LTL formula ([T]).- Many interesting LTL 
specifications can be cast in the form of ([TJ- For example, 
suppose that we want to minimize the time between satisfy- 
ing instances of a disjunction of propositions Via,;. We can 
write this in the formula ([TJ by defining a new proposition 
TT which is satisfied at each state in which a a^ is satisfied. 

In addition, the LTL formula </? in (fTb allows us to specify 
various rich robot motion requirements. An example of 
such is global absence (G ^■0, globally keep avoiding ijf), 
response (G {ipi => F-02), whenever -01 holds true, ^'2 will 
happen in future), reactivity (G F ^Ai ^ G F '02, if "01 holds 
in future for any time point, ?/)2 has to happen in future for 
any time point as well), sequencing (4>i U ip2^ "4^3, i'l holds 
until i/'2 happens, which holds until V's happens), and many 
others. For concrete examples, see Section IV] D 

IV. Problem Solution 



In this section we describe our solution to Problem IlII. 1 1 
We leverage ideas from the automata-theoretic approach to 
model checking. 




Fig. 4. Product automaton between the transition system in Figure Inland 
the Biichi automaton in Figure l3] 



A. The Product Automaton 

Consider the weighted transition system T = 
{Q,qo,R,Il,£,w), and a proposition tt G H. In addition, 
consider an LTL formula (p ~ (fAGF it over 11 in form Q, 
translated into a Biichi automaton B^ = {S, 80,2^,6, F). 
With these two components, we define a new object, which 
we call the product automaton, that is suitably defined for 
our problem. 

Definition IV.l (Product Automaton) The product 

automaton V = T x B^ between the transition system 
T and the Biichi automaton B^ is defined as the tuple 

V :— {S-p , S-p fi, 5-p , F-p ,w-p , S-p _Tr), consisting of 
(i) a finite set of states S-p — Q x S, 
(ii) a set of initial states S'-p.o = {^o} x 5*0, 
(iii) a transition relation S-p C S-p x S-p, where 

((g, s), (g, s)) S 6-p if and only if {q,q) G R and 

{.s,Ciq),s)ed. 
(iv) a set of accepting (final) states F-p = Q x F. 
(v) a weight function w-p : 6-p — > M>o, where 

Wv{{q,s),{q,s)) = w{q,q), for all {{q,s),{q,s)) G 

S-p. 
(vi) a set of states S-p^-^ C S-p in which tlie proposition tt 

holds true. Thus, {q,s) G S'-p.jr if and only ifi: G C{q). 

The product automaton (as defined above) can be seen as 
a Biichi automaton with a trivial input alphabet. Since the 
alphabet is trivial, we omit it. Thus, we say that a run r-p in 
product automaton V is accepting if mi{r-p) D F-p 7^ 0. An 
example product automaton is illustrated in Fig. |4] 

As in the transition system, we associate with each run 
^v = PaPiP2 • ■ •, a sequence of time instances Tp := 
totit2 . ■ ., where tg = 0, and ti denotes the time at which the 
ith vertex in the run is reached (t^+i = ti + wp{pi,pi^i)). 
From this time sequence we can extract a sequence Tp ^r, 
containing time instances ti, where pi G Sp^T^ (i.e. Tp ,„• 
is a sequence of satisfying instances of the optimizing 
proposition tt in T). The cost of a run rp on the product 
automaton V (which corresponds to cost function (|2| on 
transition system T) is 

C-p[r-p) = limsup(Tp^7r(* + 1) ^ "^v.-Kii)) ■ (3) 

i— >--|-oo 

The product automaton can also be viewed as a weighted 
graph, where the states define vertices of the graph and the 
transitions define the edges. Thus, we at times refer to runs 



of the product automaton as paths. A finite path is then a 
finite fragment of an infinite path. 

Each accepting run of the product automaton can be 
projected to a run of the transition system satisfying the LTL 
formula. Formally, we have the following. 

Proposition IV.2 (Product Run Projection, [8]) For any 

accepting run r-p — {q^, So)(gi, Si){q2, S2) ■ ■ ■ of the product 
automaton V, the sequence r-j- — (7o9i'?2 ■ • • is a run of T 
satisfying (p. Furthermore, the values of cost functions C-p 
and C are equal for runs rp and r^, respectively. 

Similarly, if r-j- = qoqiq2 ■ ■ ■ is a run of T sat- 
isfying (j), then there exists an accepting run r-p = 
{IOj ■^o){'1ij •Si)('?2i ^2) . . . of the product automaton V, such 
that the values of cost functions C and Cp are equal. 

Finally, we need to discuss the structure of an accepting 
run of a product automaton V. 

Definition IV.3 (Prefix-Suffix Structure) A prefix of an 
accepting run is a finite path from an initial state to an 
accepting state f G F-p containing no other occurrence of 
f. A periodic suffix is an infinite run originating at tlie 
accepting state f reached by the prefix, and periodically 
repeating a finite path originating and ending at f, and 
containing no other occurrence of f (but possibly containing 
other vertices in F-p). An accepting run is in prefix-suffix 
structure if it consists of a prefix followed by a periodic 
suffix. 

Intuitively, the prefix can be thought of as the transient, while 
the suffix is the steady-state periodic behavior 

Lemma IV.4 (Prefix-Suffix Structure) At least one of the 
accepting runs r-p ofV that minimizes cost function C-p (r-p) 
is in prefix-suffix structure. 

Proof: Let r-p be an accepting run that minimizes cost 
function Cp{r-p) and is not in prefix-suffix structure. We will 
prove the existence of an accepting run pp in prefix-suffix 
structure, such that C-p{p-p) < C-p{rp). The idea behind the 
proof is that an accepting state must occur infinitely many 
times on r-p. We then show that we can extract a finite 
path starting and ending at this accepting state which can 
be repeated to form a periodic suffix whose cost is no larger 
than C-p [r-p). 

To begin, there exists a state / G Fp occurring on r-p 
infinitely many times. Run rp consists of a prefix 7-p" ending 
at state / followed by an infinite, non-periodic suffix r™^ 
originating at the state / reached by the prefix. The suffix 
r|i'^ can be viewed as infinite number of finite paths of form 
fpiP2 ■ ..Pnf, where p, ^ / for any i G {1, . . .,n}. Let 
7?^ denote the set of all finite paths of the mentioned form 
occurring on the suffix r™^ 

Note, that each path in the set 7?. has to contain at least one 
occurrence of a state from S-p^T^. To see this, assume by way 
of contradiction that there is a path fpiP2 . ■ .Pnf that does 
not contain any state from Sp.^r. The prefix r|," followed by 
infinitely many repetitions of this path is indeed an accepting 



run of V. However, if projected into run of T, formula 
G F TT and thus also formula (f) is violated, contradicting 



Proposition IV.2 



Similarly as for infinite paths, we associate with each 
finite path of length n a sequence of time instances T-p := 
totit2 ■ ■ -tn, where to = 0, and ti denotes the time at which 
the «th vertex in the run is reached (t^+i = ti+w-p{pi,Pij^i)). 
From this time sequence we can extract a sequence T-p^.^, 
containing time instances ti, where pi e S-p,tt- 

For each finite path r E TZ with n states and k occurrences 
of a state from S-p^y^ we define the following three costs 



c{r) = maXjg{o....,fc- 



Tp(0) 

1} (Tp,7r(«- 



1) 



*f{r)^Trin)~TrAk)- 



-^vAi)) 



Further, we define an equivalence relation ^ 
follows. Let ri,r2 G TZ- ri ^ r2 if and only if 

• c(ri) ~ c{r2), and 



over TZ as 



*/ 



in) 



-f 



ir2). 



Costs c^~*, c, and c^^ can be extended to 



*f i 



J- 



, c^, and 
in a natural way. For example, we define c{7* ( [''l ~ ) — 



C *(?"), where r S [r]^. The other two costs are defined 
analogously. 

Let us extract a set TZ™^ / ^ from the set of equivalence 
classes TZ/ ^^ such that each class in 7?.'"^/^ is infinite or 
contains a finite path that is repeated in r-p infinitely many 
times. As a consequence, for each class [r]^ in 7?.'"V~' 
it holds that c^{[r]^) < Cp{r-p). The set TZ/^ is finite, 
because there is only a finite number of different values 
of costs. Furthermore, accepting run 7-73 is infinite and thus 
7?.'"'/~ is nonempty. 

Let [p\r^ £ TZ™^ / r^ now be a class such that c{r*([p]~) is 
minimal among the classes from TZ™^ / r^. 

Each time a finite path in [p]^ appears in r-p, it is followed 
by another finite path. Consider, that infinitely many times 
the "following" path comes from a class ([r]^) G 7?,'"^/^. 
Then, we must have c^^ {[p]r^)+cf~^{[r\r^) < C'p{r-p). But, 
c^^'lH-) > c-^H[pU), and thus C^^MA+c^'^iipU) < 
Cp{r-p). 

Thus we can build the run p-p as the prefix r|," followed by 
a periodic suffix p^', which is obtained by infinitely many 
repetitions of an arbitrary path p € [p]^. pv is in prefix- 
suffix structure and for its suffix pp' it also holds C-p{p-p) = 
maxigN ('ir-p.„(i + l)-T-p.^(i + l)) = max (c(p), c-''"*(p) + 
c-f{p))<Cp{rp). m 

Definition IV.5 (Suffix Cost) The cost of the suffix 
PoPi ■ ■ ■ PnPoPi ■ ■ ■ of a run r-p is defined as follows. Let 
to.o,to,iT ■ ■ T^o,n,ti,o,ti^i . . . be the sequence of times at 
which the vertices of the suffix are reached on run r-p. 
Extract the sub-sequence T^^ of times tij, where pj G S-p,Tr 
(i.e. the satisfying instances of proposition it in transition 
system T). Then, the cost of the suffix is 

C?^^(rp) = max(T™f (z + 1) - T^'^ (i)). 

From the definition of the product automaton cost Cp and 
the suffix cost C^^ we obtain the following result. 



Lemma IV.6 (Cost of a Run) Given a run r-p with prefix- 
suffix structure and its suffix poPiP2 ■ ■ • PnPoPi ■ ■ -, the value 
of the cost function C-p{r-p) is equal to the cost of the suffix 

Our aim is to synthesize a run r-j- of T minimizing the 
cost function C{r-j-) and ensuring that the word produced 
by this run will be accepted by B. This goal now translates 
to generating a run rp of T^, such that the run satisfies the 
Biichi condition Fp and minimizes cost function C-p{r-p). 
Furthermore, to find a satisfying run r-p that minimizes 
C-p{r-p), it is enough to consider runs in prefix-suffix struc- 
ture (see Lemma [lV.4| l. From Lemma [lV.6| it follows that the 
whole problem reduces to finding a periodic suffix r™^ = 
fpiP2 ...pnfpi--- in T', such that: 
(i) / is reachable from an initial state in S-p^, 
(ii) / e F-p (i.e., / is an accepting state), and 
(iii) the cost of the suffix r™^ is minimum among all the 
suffices satisfying (i) and (ii). 

Finally, we can find a finite prefix in T' leading from an initial 
state in 5*73,0 to the state / in the suffix r^^ . By concatenating 
the prefix and suffix, we obtain an optimal run in T'. By 
projecting the optimal run to T, via Proposition IV.2 we 
obtain a solution to our stated problem. 

B. Graph Algorithm for Shortest Bottleneck Cycles 

We now focus on finding an optimal suffix in the product 
automaton. We cast this problem as path optimization on a 
graph. To do this, let us define some terminology. 

A graph G = {V,E^w) consists of a vertex set V, an edge 
set i? C y X V^, and a weight function w : E ^ IR>o- A 
cycle in G is a vertex sequence uii;2 . . . t'feffe+i, such that 
{vi,Vi^i) e E for each i S {!,..., /c}, and vi — Vk+i- 
Given a vertex set S '^V, consider a cycle c = vi . . . VkVk+i 
containing at least one vertex in S. Let (ii, ^2, . . . , is) be the 
ordered set of vertices in c that are elements of S (i.e.. Indices 
with order ii < ^2 < • • • < im, such that Vj g S* if and only 
if j G {ii, i2j ■ • ■ J *s})- Then, the S -bottleneck length is 



max 

(<£{!,. ..,s} 



ie+i-1 



where ig+i ~ ii. In words, we S'-bottleneck distance is 
defined as follows. 

Definition IV.7 (S'-bottleneck lengtli) Given a graph G = 
(y, E, w), and a vertex set S (^V, the S-bottleneck length 
of a cycle in G is the maximum distance between successive 
appearances of an element of S on the cycle]}\ 

The bottleneck length of a cycle is defined as the maximum 
length edge on the cycle [20]. In contrast, the S'-bottleneck 
length measures distances between vertices in S. 

With the terminology in place, our goal is to solve the 
constrained S-bottleneck problem: 

'if the cycle does not contain an element of S, then its S-bottleneck 
length is defined as +00. 





Min-Bottleneck-Cycle(G, S, F) 



Fig. 5. A directed graph for illustrating the algorithm. The edge weights 
are given by the Euclidean distance. The set F is a singleton given by the 
blue diamond. The vertices in S are drawn as yellow squares. The thick blue 
edges in the right figure form a cycle with minimum S-bottleneck length. 



Problem Statement IV.8 Given a graph G — {V, E, w), 
and two vertex sets F,SCV, find a cycle in G containing 
at least one vertex in F, with minimum 5-bottleneck length. 

Our solution, shown in the Min-Bottleneck-Cycle 
algorithm, utilizes Dijkstra's algorithm [20] for computing 
shortest paths between pairs of vertices (called Shortest- 
Path), and a slight variation of Dijkstra's algorithm for 
computing shortest bottleneck paths between pairs of vertices 
(called Shortest-Bot-Path). 

Shortest-Path takes as inputs a graph G = {V, E, w), 
a set of source vertices A C V, and a set of destination 
vertices B CV. It outputs a distance matrix D e RI^^I^I^I, 
where the entry D{i,j) gives the shortest-path distance from 
Ai to Bj. It also outputs a predecessor matrix P e T/l-^l^l^l, 
where P{i,j) is the predecessor of j on a shortest path from 
Ai to Vj. For a vertex v ^ V, the shortest path from v to 
V is defined as the shortest cycle containing v. If there does 
not exist a path between vertices, then the distance is +00. 

Shortest-Bot-Path has the same inputs as Shortest- 
Path, but it outputs paths which minimize the maximum 
edge length, rather than the sum of edge lengths. 

Fig. [5] (left) shows an example input to the algorithm. The 
graph contains 12 vertices, with one vertex (diamond) in 
F, and four vertices (square) in S. Fig. E\ (right) shows 
the optimal solution as produced by the algorithm. The 
bottleneck occurs between the square vertices immediately 
before and after the diamond vertex. 

In the algorithm, one has to take special care that cycle 
lengths are computed properly when / = si, si = S2, or 
/ = S2- This is done by setting some entries of Dp^s and 
F>s^F to zero in step 4, and by defining the cost differently 
when / ^ si = S2 in step 5. In the following theorem we 
show the correctness of the algorithm. 

Theorem IV.9 (Min-Bottleneck-Cycle Optimality) 

The Min-Bottleneck-Cycle algorithm solves the 
constrained S-bottleneck problem (Problem \IV.8\ . 

Proof: Every valid cycle must contain at least one 
element from F and at least one element from S. Let 
c :— 'yiU2 ■ • ■ VkVi, be a valid cycle, and without loss of 
generality let vi e F. From this cycle we can extract the 



Input: A directed graph G, and vertex subsets F and S 
Output: A cycle in G which contains at least one vertex 

in F and minimizes the S'-bottleneck distance. 
1: Shortest paths between vertices in S: 

{D,P) ^ Shortest-Path(G,S',S'). 

2: Define a graph Gs with vertices S and adjacency 

matrix D. 
3: Shortest S'-bottleneck paths between vertices in S: 

{DhouPhot) ^ Shortest-Bot-Path(G5,5,5). 

4: Shortest paths from each vertex in F to each vertex in 
S, and from each vertex in S to each vertex in F: 

{Df^s,Pf^s) ^ Shortest-Path(G,F,5) 
{Ds^f,Ps^f) ^ Shortest-Path(G, 5",^). 

Set Dp^sihi) = and Ds^f{J, i) = for all z, j 

such that Fi = Sj. 
5: For each triple (/, si, S2) £ F x S x S, let G(/, si, S2) 

be Dp^sif, si) + Ds^f{s2J), if / 7^ si = S2, and 

max {L)_f^s(/, si) + Ds^Fis2, /), -Dbot(si, S2)}, 

otherwise. 
6: Find the triple (/*,s|,S2) that minimizes C{f,si,S2)- 
7: If minimum cost is +cx), then output "no cycle exists." 

Else, output cycle by extracting the path from /* to si 

using Pf^s, the path from sJ to Sj using Pbot and P, 

and the path from Sj to /* using Ps^f- 



triple {vi,Va,Vh) € F x S x S, where?;a, Vb G S, and vi ^ S 
for all i < a and for all i > b. (Note that, a = & = 1 is 
possible.) 

Consider a cycle c with corresponding triple {f, 81,82), 
and let L{c) denote its 5-bottleneck length. It is straightfor- 
ward to verify, using the definition of S'-bottleneck length, 
that i(c) > C{f,8i,82). 

The cycle computed in step 5 (as given by the four 
predecessor matrices) takes the shortest path from / to Si, 
the shortest S-bottleneck path from si to 82, and the shortest 
path from 82 to /. However, the shortest path from / to si 
(and from 82 to /) may contain other vertices from S. Thus, 
the S-bottleneck length of this cycle, denoted L{f ,81,82), 
satisfies 



Lif,8,,82)<Gif,8i,S2)<L{c), 



(4) 



implying that C{f ,81,82) upper bounds the length of the 
computed cycle. However, if we take c to be a cycle with 
minimum length, then necessarily L{c) < L{f ,81,82). 
Hence, equation Q implies that for an optimal cycle, 
L{f,8i,82) — C{f, 81,82) = L{c). Thus, by minimizing 
the cost function in step 5 we compute the minimum length 
cycle. ■ 

Computational Complexity: Finally, we characterize 
the computational complexity of the MlN-BOTTLENECK- 
Cycle algorithm. Let n, m, ns, and np, be the number 



of vertices (edges) in the sets V, E, S, and F, respectively. 
Dijkstra's algorithm can be implemented to compute shortest 
paths from a source vertex t; e F, to all other vertices in V 
in 0{n\ogn + m) run time. Thus, for sparse graphs (which 
includes many transition systems), the run time is 0{n log n). 

Proposition IV.IO (Min-Bottleneck-Cycle run time) 

The run time of the Min-BottleneCK-CyCLE algorithm 
is 0{(ns + np){ri\ogn + rii + n'g)\. Thus, in the worst-case, 
the run time is 0{tv'). For sparse graphs with ns, np <C n, 
the run time is 0[{ns + np)nlognj. 

Proof: We simply look at the run time of each step 
in the algorithm. Step 1 requires ns calls to Dijkstra's 
algorithm, and has run time 0{ng{nlog{n) + m)). Step 3 
requires ns calls to Dijkstra's algorithm on a smaller graph 
Gs = {S,Es,ws), and has run time 0{ns{nslog{ns) + 
\Es\)). Step 4 has run time 0(n_F(nlog(n) + m)). Finally, 
step 5 and 6 require searching over all np ■ n'g possibilities, 
and have run time 0{npn^). Since \Es\ < n|, the run time 
in general is given by 0[{ns + np){n\ogn + m + n'^)y ■ 



C. The Optimal-Run algorithm 

We are now ready to combine the results from the previous 
section to present a solution to Problem |III.1| The solution 
is summarized in the Optimal-Run algorithm. 

Optimal-Run(T, 0) 
Input: A weighted transition system T, and temporal 

logic specification (f> in form ([T]i. 
Output: A run in T which satisfies cj) and minimizes (|2]). 
1: Convert (/) to a Biichi automaton B^. 
2: Compute the product automaton V ~ T y^ B^. 
3: Compute the cycle 

Min-Bottleneck-Cycle(G, S-p.7T,F-p), where 

G — {S-p, S-p, w-p). 
4: Compute a shortest path from S-pfl to the cycle. 
5: Project the complete run (path and cycle) to a run on T 



using Proposition IV.2 



Combining Lemma IV.4 Theorem IV.9 and Proposi- 
tion 



IV.2 we obtain the following result. 



Theorem IV.ll (Correctness of Optimal-Run) The 



Optimal-Run algorithm solves Problem III.l 



V. Experiments 

We have implemented the Optimal-Run algorithm in 
simulation and on a physical road network testbed. The 
road network shown in Fig. [T] is a collection of roads, 
intersections, and parking lots, connected by a simple set 
of rules {e.g., a road connects two (not necessarily different) 
intersections, the parking lots can only be located on the side 
of a road). The city is easily reconfigurable through re-taping. 
The robot is a Khepera III miniature car. The car can sense 
when entering an intersection from a road, when entering a 




Fig. 6. The weighted transition system for the road network in Fig. IT] 



road from an intersection, when passing in front of a parking 
lot, when it is correctly parked in a parking space, and when 
an obstacle is dangerously close. The car is programmed with 
motion and communication primitives allowing it to safely 
drive on a road, turn in an intersection, and park. The car 
can communicate through Wi-Fi with a desktop computer, 
which is used as an interface to the user {i.e., to enter the 
specification) and to perform all the computation necessary to 
generate the control strategy. Once computed, this is sent to 
the car, which executes the task autonomously by interacting 
with the environment. 

Modeling the motion of the car in the road network 
using a weighted transition system (Def. 11. 1 1 is depicted 



in Fig. |6] and proceeds as follows. The set of states Q 
is the set of labels assigned to the intersections, parking 
lots, and branching points between the roads and parking 
lots. The transition relation R shows how the regions are 
connected and the transitions' labels give distances between 
them (measured in inches). In our testbed the robot moves at 
constant speed v, and thus the distances and travel times are 
equivalent. For these experiments, the robot can only move 
on right hand lane of a road and it cannot make a U-turn at 
an intersection. To capture this, we model each intersection 
as four different states. Note that, in reality, each state in Q 
has associated a set of motion primitives, and the selection of 
a motion primitive {e.g., go_straight, turn_right) determines 
the transition to one unique next states. This motivates our 



assumption that the weighted transition system from Def. II. 1 



is deterministic, and therefore its inputs can be removed. 

In our experiment, we have considered the following task. 
Parking spots P2 and P3 in Fig. [6] are data upload locations 
(light shaded in Fig.[8]l and parking spots PI, P4, and P5 are 
data gather locations (dark shaded in Fig.|8]l. The optimizing 
proposition tt in LTL formula ([T} is tt := P2 V P3, i.e. 
we want to minimize the time between data uploads. Both 
upload locations provide the same service. On the other hand, 
data gather locations are unique and provide the robot with 
different kind of data. Assuming infinite runs of the robot in 
the environment, the motion requirements can be specified as 
LTL formulas, where atomic propositions are simply names 
of the parking spots. Namely, in the formula ip of the LTL 
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Fig. 7. Two snapshots of the robot in road network. In the left figure the 
robot is gathering data, and in the right figure it is about to upload. 



formula ([TJ, we demand the conjunction of the following: 

• The robot keeps visiting each data gather location. 

GFPl AGFP4AGFP5 

• Whenever the robot gathers data, it uploads it before 
doing another data gather. 

G ((P1VP4VP5) ^ X (^(P1VP4VP5)Z^ (P2VP3))) 

• Whenever the robot uploads data, it does not visit an 
upload location again before gathering new data. 

G ((P2 V P3) =» X (^(P2 V P3)Z^ (PI V P4 V P5))) 

Note that the above specifications implicitly enforce G F tt. 
Running the Optimal-Run algorithm, we obtain the solu- 
tion as illustrated in the top three environment shots in Fig. [8] 
The transition system has 26 states, and the Biichi automaton 
had 16 states, giving a product automaton with 416 states. 
In the product automaton, F-p contained 52 states, and S-p,r: 
contained 32 states. The Optimal-Run algorithm ran in 
approximately 6 seconds on a standard laptop. The value 
of the cost function was 9.13 meters, which corresponded 
to a robot travel time of 3.6 minutes (i.e., the maximum 
travel time between uploads was 3.6 minutes). Our video 
submission displays the robot trajectory for this run and 
Fig. |7] shows two snapshots from the video. 

The bottom three shots in Fig. [8] illustrate the situation 
with the same motion requirements and a further restriction 
saying that the robot cannot upload data in P2 after data is 
gathered in location P5: G (P5 ^ (^P2Z^P3)). In this case 
the Biichi automaton contained 29 states, the algorithm ran 
in 22 seconds, and the value of the cost function was 9.50 
meters with a travel time of 3.77 minutes. 

VI. Conclusions and Future Directions 

In this paper we presented a method for planning the 
optimal motion of a robot subject to temporal logic con- 
straints. The problem is important in applications where the 
robot has to perform a sequence of operations subject to 
external constraints. We considered temporal logic specifica- 
tions which contain a single optimizing proposition that must 
be repeatedly visited. We provided a method for computing 
a valid robot trajectory that minimizes the maximum time 
between satisfying instances of the optimizing proposition. 
We demonstrated our method for a robotic data gathering 
mission in a city environment. 




n 



[K 



Fig. 8. The robot trajectories (blue arrows) for the data gathering mission. 
Green (dark shaded) areas are data-gathering locations, and yellow (light 
shaded) areas are upload locations. The bottom three figures show the new 
robot trajectory when we restrict data upload to location P3 (the bottom 
yellow location) after each data-gather at P5 (the rightmost green location). 



There are many promising directions for future work. We 
are looking at ways to extend the cost functions that can be 
optimized. In particular, we are looking at extensions to more 
general types of patrolling problems. Another interesting 
direction is the extension to multiple robots. This naturally 
leads to developing solutions that are distributed among the 
robots. 
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